On-line Learning of Unlearnable True Teacher through Mobile Ensemble Teachers
نویسندگان
چکیده
منابع مشابه
On-line Learning of an Unlearnable True Teacher through Mobile Ensemble Teachers
On-line learning of a hierarchical learning model is studied by a method from statistical mechanics. In our model a student of a simple perceptron learns from not a true teacher directly, but ensemble teachers who learn from the true teacher with a perceptron learning rule. Since the true teacher and the ensemble teachers are expressed as non-monotonic perceptron and simple ones, respectively, ...
متن کاملStatistical Mechanics of On-line Learning when a Moving Teacher Goes around an Unlearnable True Teacher
Department of Mathematics, Faculty of Science, Kobe University, 1–1, Rokkodai, Nada-ku, Kobe 657–8501 Department of Electronic Engineering, Kobe City College of Technology, 8–3 Gakuen-higashimachi, Nishi-ku, Kobe, 651–2194 Division of Transdisciplinary Sciences, Graduate School of Frontier Sciences, The University of Tokyo, 5–1–5 Kashiwanoha, Kashiwa-shi, Chiba, 277–8561 RIKEN Brain Science Ins...
متن کاملStatistical Mechanics of On-line Ensemble Teacher Learning through a Novel Perceptron Learning Rule
In ensemble teacher learning, ensemble teachers have only uncertain information about the true teacher, and this information is given by an ensemble consisting of an infinite number of ensemble teachers whose variety is sufficiently rich. In this learning, a student learns from an ensemble teacher that is iteratively selected randomly from a pool of many ensemble teachers. An interesting point ...
متن کاملOn-Line AdaTron Learning of Unlearnable Rules
We study the on-line AdaTron learning of linearly non-separable rules by a simple perceptron. Training examples are provided by a perceptron with a non-monotonic transfer function which reduces to the usual monotonic relation in a certain limit. We find that, although the on-line AdaTron learning is a powerful algorithm for the learnable rule, it does not give the best possible generalization e...
متن کاملStatistical Mechanics of Nonlinear On-line Learning for Ensemble Teachers
Department of Electronic Engineering, Kobe City College of Technology, 8–3 Gakuen-higashimachi, Nishi-ku, Kobe, 651–2194 2 Department of Electrical and Electronic Engineering, Faculty of Engineering, Kobe University, 1–1, Rokkodai, Nada-ku, Kobe 657–8501 Division of Transdisciplinary Sciences, Graduate School of Frontier Sciences, The University of Tokyo, 5–1–5 Kashiwanoha, Kashiwa-shi, Chiba, ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of the Physical Society of Japan
سال: 2008
ISSN: 0031-9015,1347-4073
DOI: 10.1143/jpsj.77.094801